Code coverage while running web server

--0016e6d99beda3b47a047afa4d37
Content-Type: text/plain; charset=ISO-8859-1

I am working on a project which requires running httpd web server. I need to
ensure that all the important code paths are covered while the web server is
running. I looked around for test scripts which can help in doing that, but
couldn't find any. Are there any test suite or bunch of functional test
scripts which the developers might use to test the web server before
official releases ?

Thanks a ton !
Guruprasad

--0016e6d99beda3b47a047afa4d37
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable


I am working on a project which requires running httpd web server. I ne=
ed to ensure that all the important code paths are covered while the web se=
rver is running.=A0 I looked around for test scripts which can help in doin=
g that, but couldn't find any. Are there any test suite or bunch of fun=
ctional test scripts which the developers might use to test the web server =
before official releases ?



Thanks a ton !
Guruprasad


--0016e6d99beda3b47a047afa4d37--

Re: Code coverage while running web server

On Thu, Dec 17, 2009 at 9:49 PM, Guruprasad JG wr=
ote:
>
> I am working on a project which requires running httpd web server. I need=
to
> ensure that all the important code paths are covered while the web server=
is
> running.  I looked around for test scripts which can help in doing t=
hat, but
> couldn't find any. Are there any test suite or bunch of functional test
> scripts which the developers might use to test the web server before
> official releases ?
>
> Thanks a ton !
> Guruprasad
>

When you talk about code paths, it's meaningless without specifying
what type of code you're using (language). I'm familiar with Java and
PHP and I've heard of several unit testing suites for each.
But those would be questions for a different list...since Apache is an
http server, you might just be talking about checking URLs. In that
case I doubt any such script exists, as the complex part would be
defining the ontology of your website's valid locations. The rest is
pretty trivial, loop through the urls, make an http request with curl
or wget or something for each of them, and scrub the response for the
HTTP status code.

------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

Re: Code coverage while running web server

--0016e6dab022744bd4047b09f75b
Content-Type: text/plain; charset=ISO-8859-1

I am referring to the Apache code written in C. I would like to see if all
the paths are exercised for - request processing, resource management,
connection pooling, and configuration directives of the apache core. This
would be more like functional testing of apache.

On Fri, Dec 18, 2009 at 3:42 AM, Jonathan Zuckerman
wrote:

> On Thu, Dec 17, 2009 at 9:49 PM, Guruprasad JG
> wrote:
> >
> > I am working on a project which requires running httpd web server. I need
> to
> > ensure that all the important code paths are covered while the web server
> is
> > running. I looked around for test scripts which can help in doing that,
> but
> > couldn't find any. Are there any test suite or bunch of functional test
> > scripts which the developers might use to test the web server before
> > official releases ?
> >
> > Thanks a ton !
> > Guruprasad
> >
>
> When you talk about code paths, it's meaningless without specifying
> what type of code you're using (language). I'm familiar with Java and
> PHP and I've heard of several unit testing suites for each.
> But those would be questions for a different list...since Apache is an
> http server, you might just be talking about checking URLs. In that
> case I doubt any such script exists, as the complex part would be
> defining the ontology of your website's valid locations. The rest is
> pretty trivial, loop through the urls, make an http request with curl
> or wget or something for each of them, and scrub the response for the
> HTTP status code.
>
> ------------------------------------------------------------ ---------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>

--0016e6dab022744bd4047b09f75b
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

I am referring to the Apache code written in C. I would like to see if all =
the paths are exercised for - request processing, resource management, conn=
ection pooling, and configuration directives of the apache core. This would=
be more like functional testing of apache.

Re: Code coverage while running web server

On Sat, Dec 19, 2009 at 1:30 AM, Guruprasad JG wrote:
> I am referring to the Apache code written in C. I would like to see if all
> the paths are exercised for - request processing, resource management,
> connection pooling, and configuration directives of the apache core. This
> would be more like functional testing of apache.

I think you'll have to explain to us what you exactly mean with
checking that "all the paths are exercised". I have no clue how to
"exercise paths" in any context, and I do consider my knowledge of the
English language quite substantial. Maybe you should rephrase your
question.
If you just want to know what goes on inside Apache when a request is
processed than you can ofcourse run it in a debugger. Will be slow,
though. Make sure the timeout in whatever client you use is high
enough.

Krist


--
krist.vanbesien@gmail.com
krist@vanbesien.org
Bremgarten b. Bern, Switzerland
--
A: It reverses the normal flow of conversation.
Q: What's wrong with top-posting?
A: Top-posting.
Q: What's the biggest scourge on plain text email discussions?

------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

Re: Code coverage while running web server

On Sun, Dec 20, 2009 at 12:37 AM, Krist van Besien
wrote:
> On Sat, Dec 19, 2009 at 1:30 AM, Guruprasad JG =
wrote:
>> I am referring to the Apache code written in C. I would like to see if a=
ll
>> the paths are exercised for - request processing, resource management,
>> connection pooling, and configuration directives of the apache core. Thi=
s
>> would be more like functional testing of apache.
>
> I think you'll have to explain to us what you exactly mean with
> checking that "all the paths are exercised". I have no clue how to
> "exercise paths" in any context, and I do consider my knowledge of the
> English language quite substantial. Maybe you should rephrase your
> question.
> If you just want to know what goes on inside Apache when a request is
> processed than you can ofcourse run it in a debugger. Will be slow,
> though. Make sure the timeout in whatever client you use is high
> enough.
>
> Krist
>
>
> --
> krist.vanbesien@gmail.com
> krist@vanbesien.org
> Bremgarten b. Bern, Switzerland
> --
> A: It reverses the normal flow of conversation.
> Q: What's wrong with top-posting?
> A: Top-posting.
> Q: What's the biggest scourge on plain text email discussions?
>
> ------------------------------------------------------------ ---------
> The official User-To-User support forum of the Apache HTTP Server Project=
..
> See for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>   "   from the digest: users-digest-unsubscribe@httpd.apache.or=
g
> For additional commands, e-mail: users-help@httpd.apache.org
>
>

I believe he is asking for a unit testing suite for Apache, to create
scenarios that execute every line of code in the apache webserver so
that they can verify that everything works properly, I think as a
request it's pretty ambitious...

------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

Re: Code coverage while running web server

--0016e6d7e034a125cf047b25d2da
Content-Type: text/plain; charset=ISO-8859-1

Ok, here is what I am trying to do. I have modified the kernel to track some
of the system calls made by apache at run time. I want to ensure that all
possible invocations of those system calls in any place in the apache code
are invoked. This means that if I run gcov or any code coverage tool on the
apache, I would see close to 90-100% of code being covered during that run
of apache.
I assumed that since apache is open source, these would also be.



On Sun, Dec 20, 2009 at 3:37 AM, Krist van Besien > wrote:

> On Sat, Dec 19, 2009 at 1:30 AM, Guruprasad JG
> wrote:
> > I am referring to the Apache code written in C. I would like to see if
> all
> > the paths are exercised for - request processing, resource management,
> > connection pooling, and configuration directives of the apache core. This
> > would be more like functional testing of apache.
>
> I think you'll have to explain to us what you exactly mean with
> checking that "all the paths are exercised". I have no clue how to
> "exercise paths" in any context, and I do consider my knowledge of the
> English language quite substantial. Maybe you should rephrase your
> question.
> If you just want to know what goes on inside Apache when a request is
> processed than you can ofcourse run it in a debugger. Will be slow,
> though. Make sure the timeout in whatever client you use is high
> enough.
>
> Krist
>
>
> --
> krist.vanbesien@gmail.com
> krist@vanbesien.org
> Bremgarten b. Bern, Switzerland
> --
> A: It reverses the normal flow of conversation.
> Q: What's wrong with top-posting?
> A: Top-posting.
> Q: What's the biggest scourge on plain text email discussions?
>
> ------------------------------------------------------------ ---------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>

--0016e6d7e034a125cf047b25d2da
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Ok, here is what I am trying to do. I have modified the kernel to track som=
e of the system calls made by apache at run time. I want to ensure that all=
possible invocations of those system calls in any place in the apache code=
are invoked. This means that if I run gcov or any code coverage tool on th=
e apache, I would see close to 90-100% of code being covered during that ru=
n of apache.

I assumed that since apache is open source, these would also be.

>

Re: Code coverage while running web server

On Sun, Dec 20, 2009 at 1:42 AM, Jonathan Zuckerman
wrote:
> On Sun, Dec 20, 2009 at 12:37 AM, Krist van Besien
> wrote:
>> On Sat, Dec 19, 2009 at 1:30 AM, Guruprasad JG =
wrote:
>>> I am referring to the Apache code written in C. I would like to see if =
all
>>> the paths are exercised for - request processing, resource management,
>>> connection pooling, and configuration directives of the apache core. Th=
is
>>> would be more like functional testing of apache.
>>
>> I think you'll have to explain to us what you exactly mean with
>> checking that "all the paths are exercised". I have no clue how to
>> "exercise paths" in any context, and I do consider my knowledge of the
>> English language quite substantial. Maybe you should rephrase your
>> question.
>> If you just want to know what goes on inside Apache when a request is
>> processed than you can ofcourse run it in a debugger. Will be slow,
>> though. Make sure the timeout in whatever client you use is high
>> enough.
>>
>> Krist
>>
>>
>> --
>> krist.vanbesien@gmail.com
>> krist@vanbesien.org
>> Bremgarten b. Bern, Switzerland
>> --
>> A: It reverses the normal flow of conversation.
>> Q: What's wrong with top-posting?
>> A: Top-posting.
>> Q: What's the biggest scourge on plain text email discussions?
>>
>> ------------------------------------------------------------ ---------
>> The official User-To-User support forum of the Apache HTTP Server Projec=
t.
>> See for more info.
>> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>>   "   from the digest: users-digest-unsubscribe@httpd.apache.o=
rg
>> For additional commands, e-mail: users-help@httpd.apache.org
>>
>>
>
> I believe he is asking for a unit testing suite for Apache, to create
> scenarios that execute every line of code in the apache webserver so
> that they can verify that everything works properly, I think as a
> request it's pretty ambitious...
>

I should say, as a request *to the apache users group*.. there's
probably a mailing list for contributors to the project who actually
write C code, where this question might make more sense.

------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

Re: Code coverage while running web server

--0016e6dab0229d30f1047b25f72d
Content-Type: text/plain; charset=ISO-8859-1

I will trying posting it in the dev list. Thanks !

On Sun, Dec 20, 2009 at 4:45 AM, Jonathan Zuckerman
wrote:

> On Sun, Dec 20, 2009 at 1:42 AM, Jonathan Zuckerman
> wrote:
> > On Sun, Dec 20, 2009 at 12:37 AM, Krist van Besien
> > wrote:
> >> On Sat, Dec 19, 2009 at 1:30 AM, Guruprasad JG
> wrote:
> >>> I am referring to the Apache code written in C. I would like to see if
> all
> >>> the paths are exercised for - request processing, resource management,
> >>> connection pooling, and configuration directives of the apache core.
> This
> >>> would be more like functional testing of apache.
> >>
> >> I think you'll have to explain to us what you exactly mean with
> >> checking that "all the paths are exercised". I have no clue how to
> >> "exercise paths" in any context, and I do consider my knowledge of the
> >> English language quite substantial. Maybe you should rephrase your
> >> question.
> >> If you just want to know what goes on inside Apache when a request is
> >> processed than you can ofcourse run it in a debugger. Will be slow,
> >> though. Make sure the timeout in whatever client you use is high
> >> enough.
> >>
> >> Krist
> >>
> >>
> >> --
> >> krist.vanbesien@gmail.com
> >> krist@vanbesien.org
> >> Bremgarten b. Bern, Switzerland
> >> --
> >> A: It reverses the normal flow of conversation.
> >> Q: What's wrong with top-posting?
> >> A: Top-posting.
> >> Q: What's the biggest scourge on plain text email discussions?
> >>
> >> ------------------------------------------------------------ ---------
> >> The official User-To-User support forum of the Apache HTTP Server
> Project.
> >> See for more info.
> >> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> >> " from the digest: users-digest-unsubscribe@httpd.apache.org
> >> For additional commands, e-mail: users-help@httpd.apache.org
> >>
> >>
> >
> > I believe he is asking for a unit testing suite for Apache, to create
> > scenarios that execute every line of code in the apache webserver so
> > that they can verify that everything works properly, I think as a
> > request it's pretty ambitious...
> >
>
> I should say, as a request *to the apache users group*.. there's
> probably a mailing list for contributors to the project who actually
> write C code, where this question might make more sense.
>
> ------------------------------------------------------------ ---------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>

--0016e6dab0229d30f1047b25f72d
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

I will trying posting it in the dev list. Thanks !

Re: Code coverage while running web server

Krist van Besien wrote:
> On Sat, Dec 19, 2009 at 1:30 AM, Guruprasad JG wrote:
>> I am referring to the Apache code written in C. I would like to see if all
>> the paths are exercised for - request processing, resource management,
>> connection pooling, and configuration directives of the apache core. This
>> would be more like functional testing of apache.
>
> I think you'll have to explain to us what you exactly mean with
> checking that "all the paths are exercised". I have no clue how to
> "exercise paths" in any context, and I do consider my knowledge of the
> English language quite substantial. Maybe you should rephrase your
> question.
> If you just want to know what goes on inside Apache when a request is
> processed than you can ofcourse run it in a debugger. Will be slow,
> though. Make sure the timeout in whatever client you use is high
> enough.

This is a common phrase in software engineering. The only solution to
achieve code coverage is to instrument httpd with a code coverage tool,
and test it.

See the http://httpd.apache.org/test/ page and the repository at
http://svn.apache.org/viewvc/httpd/test/framework/trunk/ for the test
framework of httpd. Patches to increase code coverage would be welcome.

You will not achieve 100% on a single box, due to the platform differences
in the code paths.

------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

Re: Code coverage while running web server

--0016e6d7790ca7af45047b4c77d0
Content-Type: text/plain; charset=ISO-8859-1

This was exactly what I was looking for.

Thanks !

On Mon, Dec 21, 2009 at 1:44 PM, William A. Rowe Jr. wrote:

> Krist van Besien wrote:
> > On Sat, Dec 19, 2009 at 1:30 AM, Guruprasad JG
> wrote:
> >> I am referring to the Apache code written in C. I would like to see if
> all
> >> the paths are exercised for - request processing, resource management,
> >> connection pooling, and configuration directives of the apache core.
> This
> >> would be more like functional testing of apache.
> >
> > I think you'll have to explain to us what you exactly mean with
> > checking that "all the paths are exercised". I have no clue how to
> > "exercise paths" in any context, and I do consider my knowledge of the
> > English language quite substantial. Maybe you should rephrase your
> > question.
> > If you just want to know what goes on inside Apache when a request is
> > processed than you can ofcourse run it in a debugger. Will be slow,
> > though. Make sure the timeout in whatever client you use is high
> > enough.
>
> This is a common phrase in software engineering. The only solution to
> achieve code coverage is to instrument httpd with a code coverage tool,
> and test it.
>
> See the http://httpd.apache.org/test/ page and the repository at
> http://svn.apache.org/viewvc/httpd/test/framework/trunk/ for the test
> framework of httpd. Patches to increase code coverage would be welcome.
>
> You will not achieve 100% on a single box, due to the platform differences
> in the code paths.
>
> ------------------------------------------------------------ ---------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>

--0016e6d7790ca7af45047b4c77d0
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

This was exactly what I was looking for.

Thanks !